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Randomized Controlled Trials have had many sta- 
tistical developments since their introduction into 
modern medicine sixty years ago. While many of the 
advances have addressed general design and analy- 
sis issues, most have been motivated by or focused 
on assessment of efficacy in contrast to safety. The 
reporting of harms is demonstrably weak (loanni- 
dis and Lau, 2001; Loke and Derry, 2001) and, in 
spite of the CONSORT guideline on harms (loan- 
nidis et al., 2004), continues to show some deficien- 
cies (Pitrou et al., 2009). Analytical developments 
focused on harms have been very limited, reflecting 
lack of statistical effort employed in that area as well 
as perhaps a general neglect of the less exciting area 
of safety. 

DuMouchel made a major contribution to extract- 
ing useful information from spontaneous reports us- 
ing Bayesian methods (DuMouchel, 1999; DuMou- 
chel and Pregibon, 2001). This paper (DuMouchel, 
2012) is potentially an important advance in assess- 
ing data on harms from randomized trials. As an 
incidental point, it is possible it will also have ap- 
plication in observational studies as well. 

There are several really important features of 
MBLR as set out by DuMouchel: 

(1) It addresses a clinically relevant problem, not 
addressed by standard methods. The problem being 
that it is difficult if not impossible to prespecify pos- 
sible harms in terms of formal hypotheses and the 
multiple medically related issues need to be seen as 
a broad picture as well as being refiected by nar- 
row medical terms. In practice, also the data may 
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be very limited because serious harms are rare for 
medicines reaching the market. 

(2) It addresses at least part of the problem of 
multiplicity of many possible hypotheses of harm. 

(3) It avoids the epidemiological dilemma of lump- 
ing or splitting terms which can lead to reduced sen- 
sitivity or simple loss of statistical power. It also 
avoids the difficulty caused by composite outcomes 
which, although they have their place in assessing 
efficacy, have problems in that context but poten- 
tially worse problems in the context of safety. 

(4) It provides medically useful and interpretable 
estimates of effects while retaining a good statisti- 
cal foundation. The modeling is consistent for each 
response variable related to a possible harm, and 
can be used in trials which are primarily aimed at 
testing for efficacy. 

(5) It does not seem heavily reliant on the par- 
ticular form of the Bayesian Priors being used. 

The potential of the method is therefore very con- 
siderable and seems destined to be used by the phar- 
maceutical industry and may eventually be encour- 
aged by regulators if it is shown in practice to be use- 
ful, applicable and reasonably easily implemented. 

Nothing in life is perfect though! It does require 
prespecification of a group of medically-related terms, 
expressed as simple binary responses and expected 
to behave in a similar manner (on a relative or odds 
ratio scale) — showing exchangeability in Bayesian 
parlance. This may not always be simple to do in 
practice, and even with the use of a hierarchical 
medical dictionary like MedDRA which has over 
16,000 "preferred terms," the choice of the number 
of terms and how wide a range is included will not al- 
ways be easy. There is then a danger that a nonpre- 
specified analysis may reach the conclusion desired 
by the analyst or sponsor. It will be interesting to see 
if the MBLR method can be applied to the more lim- 
ited number of terms in the internationally agreed 
"Standardized MedDRA Queries" which are already 
groupings of terms from one or more MedDRA Sys- 
tem Organ Classes (SOCs) that relate to a defined 
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medical condition or area of interest. Similarly, it 
may be possible to use a form of cluster analysis to 
provide medically sensible groupings based on one 
set of data (not necessarily from RCTs) and then to 
apply MBLR using these empirically derived group- 
ings. 

The covariates in this formulation also have to be 
expressed as binary explanatory variables, though 
this is not a major problem. 

The important idea of "borrowing strength" seems 
here to be less dependent on the form of the prior 
than is the method suggested by Berry and Berry 
(2004); see Prieto-Merino and Evans (2009). 

One issue that may be of relevance is how well 
this borrowing of strength works in slightly different 
contexts. In this example, all ten terms are showing 
conventionally "statistically significant" differences 
with treatment so it could be argued that the MBLR 
adds little to the understanding. Display 4 shows 
this and though there is what may be a helpful ef- 
fect for estimation of the OR for anuria, there is 
(as expected given the data) relatively little effect 
elsewhere. The consistent effect in this data set may 
be rather rare in other situations where the MBLR 
might be used and more investigation of its proper- 
ties is required. The simulation provides some help 
and reassurance that the method will perform well 
under some conditions, but real life may be more 
complex. 

The effects of sample size, number of covariates 
and number of response variables studied on the 
overall results is not yet clear. 

It is stated that the computational burden is not 
great and the algorithms suggested do not require 
Gibbs sampling or Markov Chain Monte Carlo meth- 
ods, so making the method more accessible to med- 
ical researchers. This reader is not sure how easy 
it will be to implement MBLR in more standard 
software and whether investigators will find it eas- 



ier than using WINBUGS or similar public domain 
software is not clear. 

In spite of these possible problems, the MBLR 
method shows very great potential and is a real ad- 
vance that will require further testing. It may be 
a way of doing meta-analysis of RCT data where 
multiple response variables are studied both for ef- 
ficacy and for safety. Might it avoid the composite 
variable problems in analyses of RCTs for efficacy? 
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